SPECIFICATION 



Electronic Version 1.2.8 
Stylesheet Version 1 .0 

METHOD AND SYSTEM FOR 
UNSUPERVISED TRANSFER 
FUNCTION GENERATION FOR 
IMAGES OF RENDERED VOLUMES 

Federal Research Statement 

[The US Government may have certain rights in this invention pursuant to contract 
number MDA 905-00-1-0041 awarded by the United States Navy.] 

Background of Invention 

[0001] This invention relates generally to volume rendering in medical imaging, and more 
particularly, to a method and system for readily generating transfer functions for 
visualization of rendered volumes. 

[0002] Mammography is a low-dose x-ray procedure that creates one or more images of 
a patient's breasts desirable for detection of early stages of cancer. FIG. 1 illustrates 
one example of a prior art mammography machine 10. Mammography machine 10 
generally includes an x-ray tube 12 attached to an arm 14, which arm 14 is pivotally 
attached to a support 1 6 f and a film plate or digital detector 18 attached to an arm 
20, which arm 20 is also pivotally attached to support 1 6. X-ray tube 1 2 and arm 1 4, 
and digital detector 1 8 and arm 20, are counterbalanced so that x-ray tube 1 2 and 
digital detector 18 may be easily manually pivoted, upwardly and downwardly, and 
locked in position at different angular orientations. 

[0003] A typical mammography procedure takes approximately thirty minutes. The 

procedure generally includes obtaining two images of each of the patient's breasts, 
one from above and one from the side. For example, separate images are obtained of 
each of the patient's breasts with x-ray tube 12 and digital detector 18 disposed in a 
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vertically orientated arrangement along axis A (i.e., cranio-caudal) as shown in FIG. 1 . 
In addition, separate images are obtained of each of the patient's breasts with x-ray 
tube 12 and digital detector 18 oriented at an angle, e.g., along axis Bl (i.e., medio- 
lateral oblique) for one of the patient's breasts, and along axis B2 for the patient's 
other breast. 

[0004] During the procedure, the patient's breast is compressed between a compression 
paddle 22, e.g., a piece of radiographically transparent plastic, and digital detector 
cover 1 8 to flatten the breast, thereby decreasing the thickness and spreading the 
breast tissue, making the breast easier to be imaged. In obtaining the images, either 
from above or from the side, x-ray tube 1 2 is generally aligned perpendicular or 
normal to film plate or digital detector 1 8. A physician or radiologist then reviews the 
images of the breast, i.e., mammograms, to identify any breast cancer. 

[0005] While the above described procedure is one of the best methods of detecting early 
forms of breast cancer, it is still possible for the breast cancer to be missed by a 
physician or radiologist reviewing the mammograms. For example, breast cancer may 
* be missed by being obscured by radiographically dense, fibroglandular breast tissue, 
which is superimposed on the structures of interest in the mammogram. 

[0006] Tomosynthesis breast imaging, in which a plurality of images or projection 
radiographs are acquired as the x-ray source is moved in an arc relative to the 
stationary breast and a stationary digital detector, has been studied in an effort to 
improve early detection of breast cancer. By shifting, scaling, and adding the plurality 
of projection radiographs, it is possible to reconstruct any plane in the breast being 
imaged that is parallel to the detector, thereby "removing"superimposed tissue from 
the structures of interest. 

[0007] Visualizing micro-calcifications and masses, cysts, and other diagnostically 

relevant structures of the breast in a series of two-dimensional (2D) planes acquired 
from tomosynthesis breast imaging provides important diagnostic information. 
However, the volume of data is generally large and contains a considerable range of 
data content. Thus, radiologists essentially attempt to conceptually reconstruct these 
planes into a 3D structure by viewing approximately, for example, 60-80 images 
(usually 10 images for each cm of compressed breast thickness and each typically has 
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a 2304x1 800 matrix size) which makes this task difficult and time-consuming. 



[0008] 



Volume rendering provides a three-dimensional (3D) visualization of an object 



volume. Volume rendering has proven to be particularly useful in medical imaging to 
screen or diagnose patients using 3D tomography data (e.g. computed tomography 
(CT), magnetic resonance (MR), and, most recently, 3D digital X-ray Mammography 
(3DDM)). One of the issues that hinders the usage of the volume rendering technique 
is the definition of initial transfer functions that would show content of the volumetric 
data that would be useful in diagnosis. 

[0009] A transfer function is a mechanism for mapping the data values of individual 

voxels to colors and opacities. Typically, the transfer functions are generated based 
on prior knowledge of the 3D tomography data. For instance, in CT the range of the 
intensity values measured in CT Hounsfield numbers are approximately known and 
reproducible for a variety of tissue types. Using such prior knowledge enables a user 
to determine and manipulate transfer functions that are necessary to visualize the 
rendered volumes. 

[0010] Unlike CT data, the tissue intensity values are not generally reproducible in MR 
due to the lack of a corresponding concept to Hounsfield numbers. Generally, soft 
tissues in MR images have high contrast as well as high signal-to-noise ratio (SNR), 
particularly when data is acquired by high super-conducting magnets. Therefore, 
transfer functions may generally be set using a simple linear ramp between the 
minimum intensity value and the maximum intensity value from the 3D data set to 
sufficiently visualize the rendered volume. However, for data with low contrast and 
low SNR data (e.g. 3DDM), such a linear ramp may be unacceptable to volume render 
the data in a suitable manner. Attempting to manually manipulate the transfer 
functions is typically not practical as it is time consuming and clinically not feasible. 

[001 1] What is needed, therefore, is a method and system for readily determining 

transfer functions suitable for volume rendering 3D data that has low SNR and low 
contrast. 

Summary of Invention 

[001 2] ^ method and system are provided for generating transfer functions for use in 



# • 

volume rendering of three-dimensional data of an object volume. 

[001 3] In a first aspect, the method comprises obtaining the three-dimensional data of 
the object volume, evaluating selected characteristics for a plurality of samples of the 
three-dimensional data and computing a transfer function range for volume rendering 
the three-dimensional data based on the selected characteristics. 

[0014] In a second aspect, the system comprises an imaging device and an image 

processing device. The image processing device is adapted to generate at least one 
three-dimensional image data set of the object volume based on obtained image data 
and is further adapted to compute a transfer function range for use in volume 
rendering. 

Brief Description of Drawings 

The features and advantages of the present invention will become apparent from 
the following detailed description of the invention when read with the accompanying 
drawings in which: 

FIG. 1 is a perspective view of a prior art x-ray mammography machine; 

FIG. 2 is a diagrammatic, front elevational view of an apparatus for obtaining 
tomosynthesis data of a patient's breast to which embodiments of the present 
invention are applicable; 

FIG. 3 is a diagrammatic, front elevational view of the apparatus, shown in FIG. 2, 
configured for obtaining tomosynthesis data of the patient's other breast; 

FIGS. 4-6 are partial graphical illustrations of distance or angle, velocity, and 
acceleration, respectively, of the motion of the x-ray source, shown in FIGS. 2 and 3, 
over time during a procedure for obtaining projection radiographs used for generating 
tomographic data; 

FIG. 7 is a graphical illustration similar to FIG. 4 which spans a period of time for 
obtaining a plurality of images; 

FIG. 8 is a schematic depicting a ray cast through a data volume in accordance 
with embodiments of the present invention; and, 
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[0022] FIG. 9 is a graphical illustration of two piecewise linear transfer functions useful in 
embodiments of the present invention. 

Detailed Description 

[0023] An apparatus 100 for obtaining x-ray projection radiographs used for generating 
tomosynthesis data of an object 1 02 such as a patient's breast for early detection of 
cancer is illustrated in FIGS. 2 and 3. In this exemplary embodiment/the apparatus 
operates in conjunction with gravity to smoothly move a radiation source through a 
plurality of positions relative to a radiation detector and the patient's breast to obtain 
a plurality of projection radiograph of the patient's breast which can be processed for 
examination by a physician or radiologist. 

[0024] The actuator is operable to control movement of the radiation source so that the 
radiation source substantially stops at the plurality of positions and is operable to 
smoothly transition the radiation source between the plurality of positions. Desirably, 
the acceleration of the radiation source varies in general smoothly, e.g. sinusoidally, 
over time. 

[0025] Alternatively, an arm having a first end portion is attached to the radiation source 
and a second end portion is pivotally attached to a support so that the radiation 
source is movable along an arc. A hydraulic system operably connectable to the arm 
controllably allows the radiation source to move under the influence of gravity from at 
least one elevated position to at least one lower position relative to the radiation 
detector, wherein radiation emitted from the radiation source at a plurality of 
positions between the at least one elevated position and the at least one lower 
position and passing through the object is detectable by the radiation detector. As 
used herein, "under the influence of gravity" and the like refers to gravity being the 
motive force for transitioning the x-ray source from one position to a next sequential 
position as the source is moved to obtained the desired tomosynthesis data. Further, 
as used herein, "operably connected"and the like refers to a coupling of components 
together to enable the components to provide a desired operation or movement; 
examples include, but are not limited to, mechanical coupling by means of fasteners 
(such as cotter pin couplings, spring release latches, and the like) that provide a 
detachable coupling between component parts. 
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[0026] A method for obtaining tomosynthesis data of an object comprises the steps of 
positioning a radiation source in an elevated position with the object disposed 
between the radiation source and a radiation detector, irradiating the object with 
radiation at a plurality of radiating positions as the radiation source is allowed to 
move under the influence of gravity from an elevated position to a lower position, and 
detecting radiation passing through the object at the plurality of positions with the 
radiation detector. The method further includes the step of generating, from 
projection radiographs derived by detecting radiation passing through the object at 
each of the plurality of positions, a plurality of spaced-apart planar images through 
the object. *~' 

[0027] Such an apparatus is simpler and more robust than, for example, a mammography 
machine with one or more servomotors, which are used to physically move and 
yp position the x-ray source relative to the digital detector. Such a motorized system 

jLj imparts thrusting or jolting motions to the machine that affects the ability to maintain 

fU the detector and the patient's breast in a stationary or fixed position throughout the 

jf! procedure. Advantageously, the apparatus limits abrupt thrusting or jolting motions 

^ throughout the apparatus, so that the detector and the patient's breast is better 

G maintained in a stationary position throughout the procedure. 

"%>} 

: 

[ k ! [0028] Exemplary apparatus 1 00 includes an x-ray source 1 1 0, a detector 1 20, and an 
B actuator 1 30 for controllably allowing x-ray source 1 1 0 to move under the influence 

of gravity relative to detector 1 20. Actuator 1 30 includes a support 1 31 , a first arm 
1 32 (also referred to x-ray source arm) attached to support 131 and to x-ray source 
1 1 0, a second arm 1 34 (also referred to as x-ray detector arm) attached to support 
131 and to detector 1 20, and an actuating system 140. 

[0029] 

X-ray source 1 1 0 is typically an x-ray tube and detector 120 is typically a digital 
x-ray detector. For example, detector 1 20 may be a solid state radiation imager, 
having e.g., a cesium iodide phosphor (scintillator) on an amorphous silicon 
transistor-photodiode array. Other suitable detectors may include one or more charge 
coupled devices (CCD) or a direct digital detector which converts x-rays directly to 
digital signals. While detector 1 20 is illustrated as being flat and defining a flat image 
plane, other configurations of digital x-ray detectors may be suitably employed, e.g., 
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a curved-shaped digital x-ray detector having a curved image plane. 

[0030] X-ray source 1 1 0 and detector 1 20 are separately movable relative to each other. 

For example, arm 1 32 has a first end 21 1 or portion attached to x-ray source 1 1 0 and 
a second end 212 or portion pivotally attached to support 131 so that x-ray source 
1 10 is rotatable about a point or axis R in the directions indicated by curved double- 
headed arrow C. Similarly, arm 1 34 has a first end 221 or portion attached to detector 
1 20 and a second end 222 or portion pivotally attached to support 1 31 so that 
detector 1 20 is rotatable about axis R in the directions indicated by double-headed 
arrow D. 

[0031] X-ray source 1 10 and arm 1 32 are suitably weighted to provide a moment on the 
upper portion 21 1 of arm 1 32, i.e., the portion above axis R, which moment is greater 
than the moment of the lower portion 212 of arm 1 32, i.e., the portion below axis R. 
Desirably, when x-ray source 1 1 0 is positioned at a first or elevated upper position 
201 (as shown in FIGS. 2 and 3), arm 1 32 and x-ray source 1 1 0 will tend to rotate 
about axis R so that x-ray source 1 1 0 moves along arc C to a second or lower 
position 202 (as shown in phantom in FIGS. 2 and 3). 

[0032] 

In this exemplary embodiment, actuating system 140 comprises a hydraulic 
system having first and second hydraulic cylinders 142 and 144, respectively, a 
reservoir 1 60, a pump 1 70, and valves 1 72 and 1 74. Hydraulic cylinder 1 42 comprises 
a cylinder body 141 pivotally attached to support 131, and a piston 143 pivotally 
attachable at an upper end to one side of arm 1 32 for positioning x-ray source 1 1 0 
relative to detector 120. Hydraulic cylinder 144 comprises a cylinder body 145 
pivotally attached to support 131, and a piston 147 pivotally attachable at an upper 
end to the other side of arm support 1 32 for positioning x-ray source 1 1 0 relative to 
detector 1 20Reservoir 1 60, pump 1 70, and valves 1 72 and 1 74, are operably 
connected to hydraulic cylinders 142 and 144 so that fluid may be introduced into 
and removed from cylinder bodies 141 and 145 to position arm 132, and thus x-ray 
source 1 10 in an elevated position (e.g., position 201), relative to detector 120. 
Hydraulic cylinders 142 and 144 are suitably stabilized or maintained in a generally 
vertically disposed position when they are not attached to the respective sides of arm 
132, or when apparatus 100 is operated to obtain standard cranial-caudal or medio- 
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lateral oblique mammograms in which case, arm 1 32 and arm 1 34 may be suitably 
locked in a fixed position relative to support 131. 

[0033] By way of example and not limitation, the x-ray source, the support, and the arms 
typically are of a type such as General Electric Medical Systems Model Senographe 
2000D Digital Mammography System, and suitably modified as discussed above. It is 
to be appreciated by those skilled in the art that pneumatic cylinders may be suitably 
employed in place of the hydraulic cylinders. With pneumatic cylinders, a reservoir 
would not be necessary. It is also to be appreciated that various other mechanical 
components, e.g. ballscrew-drives, non-hydraulic systems and the like, may be used 
in apparatus 100 to effect the movement described above for obtaining images. 

[0034] With reference to FIG. 2, the initial setup of apparatus 100 for obtaining 

Q tomosynthesis data is as follows. Desirably, x-ray detector arm 1 34, and thus 

m detector 1 20, is disposed at a fixed angle B from vertical (shown by reference line Y in 

W Figures); typically angle B is in the range between about 50 degrees to about 70 

m 

M degrees from vertical for medio-lateral oblique views. When angle B has been 



m 



fl-f 



selected, arm 134 is secured in place to prevent movement. Hydraulic cylinder 142 is 
attached to x-ray source arm 1 32, Pump 1 70 is energized to fill cylinder body 1 43 to 
elevate and position x-ray source 1 10 at an elevated position 201 as shown in Figure 
2, e.g., at a maximum angle in accordance with known techniques from an axis LI 
extending normal to detector 1 20. 

[0035] An object volume to be imaged 1 02, such as a breast of a patient, is positioned 
between a compression paddle 122 and detector 120, and maintained in a stationary 
fixed position while x-ray source 1 1 0 is moved from the elevated position to a lower 
position 202 (shown in phantom) during which a plurality of images are obtained. The 
procedure is similar for obtaining images of the patient's other breast, but instead, 
hydraulic cylinder 1 44 is connected to arm 1 32 and motion of the arm is between the 
respective upper and lower positions 201 and 202 as illustrated in Figure 3. 

[0036] | n one aS p ec t 0 f obtaining the plurality of images, valve 1 72 may be opened to 

drain fluid from cylinder body 141 to reservoir 160 so that x-ray source 1 10 descends 
smoothly under the influence of gravity from the elevated position 201 to the lower 
position 202. As used herein, "smooth descent" and the like refer to the x-ray source 
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moving between respective radiating positions without intermediate stops and in a 
fashion that does not involve abrupt changes in acceleration. During the descent of x- 
ray source 1 1 0, a plurality, desirably between eight and fifteen, images are obtained 
by the x-ray source emitting radiation towards the object to be imaged and the 
detector. For example, for a maximum angle of ± 24 degrees, use of six degree 
intervals, positions Vthrough V shown in FIG. 2, result in obtaining nine images. 
Each position at which the source emits radiation towards the object to be imaged is a 
respective radiating position. The image obtained at each position by the detector 
desirably are acquired with a low radiation dose. The total radiation dose for all of the 
images is desirably equivalent to, or only higher by a medically insignificant amount 
than the radiation dose for a standard single view mammogram. 

[0037] Apparatus 100 desirably includes a processor 1 50 for controlling actuator system, 
~q and processing a plurality of images obtained at a plurality of positions of x-ray 

source 1 1 0 relative to detector 1 20 as further described below. 

i*k [0038] For example, a suitable inclinometer 1 80 having a sensitivity of about + /- 0.1 

if! 

~; degree may be attached to arm 1 32 and coupled to processor 1 50. Processor 1 50 

b typically also is interfaced with x-ray source 1 1 0 to supply a signal for energizing x- 

i~j ray source 1 1 0 at the appropriate positions, e.g., positions "a-i", as x-ray source 

descends from the elevated position 201 to lower position 202. Advantageously, 
y apparatus 100 includes suitable shock absorbers such as springs, or pressurized 

~ ; reservoirs to bring arm 1 32 to a gentle stop at position 202; alternatively processor 

1 50 is programmed to slowly close valve 1 72 to decelerate x-ray source 1 1 0 as it 

approaches its position 202 at the end of the scan. 

[0039] In another aspect of obtaining the plurality of images, x-ray source 1 1 0 may be 
moved to come to a rest or stop at each of the appropriate positions, e.g., positions 
"a-i", at which time (when no longer in motion) x-ray source is energized for 
generating an exposure. For example, processor 1 50 typically is interfaced with 
inclinometer 1 80 and valve 1 72 to control the descent of and cause x-ray source to 
come to a rest at each of the desired positions, as well as supply a signal for 
energizing x-ray source 1 10 while x-ray source is stopped or stationarily maintained 
at each of the desired positions. 
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[0040] From the present invention, it will be appreciated by those skilled in the art that 
instead of an inclinometer, a linear encoder or similar device can be attached to the 
hydraulic cylinder and calibrated for providing angular measurements. Similarly, the 
encoder can be interfaced with the computer and used to control the position of the 
x-ray source. 

[0041 ] FIGS. 4-6 graphically illustrate an exemplary motion of x-ray source 1 1 0 which 

desirably results in a smooth transition from the upper or elevated position 201 to the 
lower or end position 202. FIG. 4 illustrates the change in distance or angle over time 
between the stop positions of the arm (e.g., positions 201 and 202). FIGS. 5 and 6 
illustrate the change in velocity and acceleration, respectively, between the stop 
positions over time. Desirably, the accelerations and deceleration of x-ray source over 
time between the elevated position and the lower position is generally smooth, e.g. 
sinusoidal, in nature to provide the desired smoothness in motion of the arm. 



S3 [0042] Desirably, as shown in FIG. 7, the change in distance or angle between respective 

ru 

y : positions "a-i"over time for a plurality of positions results in x-ray source 1 1 0 being 

maintained in a fixed or stationary position at which time X-ray source is energized. 
The periods of time between the exposures allow the processor to read out the data 



m 

SI 



o 

fe. ; 



from the digital detector. Advantageously, x-ray source is quickly and smoothly 



FU moved during the minimum time required for reading the detector. 



[0043] In an alternative embodiment of the actuator, an intermediate pair of variable 

sized reservoirs may be used in the drain line from each of the hydraulic cylinders so 
that the pair of reservoirs are alternately filled and emptied. The volume of each 
reservoir is desirably configured to contain an amount of fluid to be drained or 
removed from the hydraulic cylinder to permit x-ray source 1 1 0 to move from one 
position to the next. For example, when a reservoir is filled, the x-ray source can be 
energized to generate an exposure. The hydraulic cylinder would then be connected 
to the other reservoir to continue the scan, while the first would be emptied into the 
lower reservoir. 

[0044] hydraulic system and motion of the x-ray source allows for the acquisition of 

the tomosynthesis images in approximately three to five seconds which is sufficiently 
rapid to make the apparatus clinically applicable. The separate projection radiographs 
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obtained during the imaging procedure typically are processed for use by the operator 
by processor 1 50 or other readout modalities coupled to the detector. 

[0045] The plurality of separate projection radiographs generated by apparatus 1 00 (x- 
ray source 1 10 located at positions "a-i"), after preprocessing, are shifted, scaled, and 
added, e.g., transformed, to reconstruct one or more planes or slices S in the object 
imaged that are parallel to the plane of detector 1 20. It is to be appreciated that one 
skilled in the art would select from a variety of reconstruction techniques suitable for 
a given imaging application. As used herein, the plurality of planes or slices are 
referred to as tomosynthesis data. Tomosynthesis data describes the reconstructed 
data whereas projection radiographs refer to the x-ray shots. Tomosynthesis allows 
reconstruction of "in-focus" tomographic planes or slices S at any level within the 
imaged object, e.g., at about 1 .0 mm spacing. Typically, equally spaced slices with a 
slice separation of about 1mm are employed. However, other spacings and/or 
irregular spacings are alternative embodiments. The values in the tomosynthesis data 
set ideally have an obvious functional relationship with the linear attenuation values of 
the corresponding structures within the imaged object. Advantageously, the invention 
allows a physician or radiologist to see through "structured noise" of normal breast 
tissue to improve detection and characterization of breast cancer. 

[0046] By way of example and not limitation, the generation of tomographic planes or 
slices S may alternatively be obtained by the processes disclosed in U.S. Patent No. 
5,872,828 to Niklason et al., or other suitable reconstruction algorithms known in the 
art. 

[0047] 

After employing the tomographic imaging methods described above, the volume 
of the resultant tomographic data is generally large and the content of the data 
generally may contain a considerable dynamic range of voxel intensity values. In 
embodiments of the present invention, methods are provided to enable visualization, 
for example for diagnosis, of tomosynthesis data having considerable data volume 
and content. With respect to the volume, the plurality of spaced-apart images 
desirably have an in-plane image resolution of 100 micron (for breast imaging) or 
better and image spacing resolution of 1000 micron or better. Typically, each image 
represents a matrix size of approximately 2304x1 800 voxels. As used herein, a voxel 
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n 



fz l 



refers to a single data point within a data volume consisting of N by N by N data 

x y z 

samples along the X, Y, and Z axes respectively. Typically, there are 10 images per cm 
of compressed thickness, with the compressed breast thickness typically ranging from 
about 4cm to about 7cm. Thus, tomographic imaging as described herein provides a 
large volume of data. With respect to the content of the data, the dynamic range of 
the data obtained by the techniques described above desirably utilizes 2 bytes of 
information (voxel intensity) to store the range difference in attenuation coefficients 
of imaged structures. There is a relationship between the voxel intensity value and the 
attenuation coefficients of the imaged structures. The output of the reconstruction 
technique can make this relationship either proportional or inversely proportional. For 
an inversely proportional relationship, the higher the attenuation coefficient of a 
structure within the breast, the lower its intensity value. For example, a micro- 
calcification has voxel values lower than voxel values associated with fibrous tissues. 
Other functional relationships between voxel intensity values and attenuation of the 
imaged structures are also possible. 



[0048] A method for generating a three-dimensional image of an object volume, for 



m 

Nf example a patient's breast, comprises obtaining tomosynthesis data of the object 



g volume as described above and generating the three-dimensional image by applying a 

^ 3D visualization technique to the tomosynthesis data. 3D visualization techniques, as 

vf used herein, refer to a variety of known volume rendering techniques such as 



maximum, minimum, composite, surface or averaged projections made at any 
arbitrary view angle in accordance with known techniques. 

[0049] Volume rendering refers to various techniques to generate projected images onto 
various imaging planes in order to generate a three-dimensional rendering of the 
imaged object volume. The tomosynthesis data, i.e., the plurality of spaced-apart 
planar images, obtained by the methods described above collectively form a three- 
dimensional data volume representing the object volume. Referring to FIG. 8, there is 
shown an exemplary data volume 40 that comprises n slices numbered from 0 to (n- 
1). The projected images are shown as 36. In order to generate three-dimensional 
images from the data volume, processor 1 50 of FIG. 2 is adapted to transform the 
data volume using volume rendering techniques. In an exemplary embodiment, 
volume rendering is performed with maximum opacity ray casting. As used herein, 
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opacity is defined as a measurement of transparency. In this embodiment, a ray 38 is 
cast through data volume 40. As ray 38 passes through each plane in data volume 40, 
a rendered image is formed by calculating and accumulating intensity from the 
intersection or ray 38 with pixels from each of the given slices of the data volume. 
Processor 1 50 iteratively performs the ray casting volume rendering in accordance 
with known methods. Generally the number of pixels for each of the directions in the 
two-dimensional slice are predetermined, e.g. number of pixels in x-direction and 
number of slices In y-direction, based on resolution requirements. Typically, the 
resolution of a final image is predetermined. However, lower resolution is often 
employed during interactive sessions to reduce processing time. In an embodiment of 
a method for generating a 3D image, a selected 3D visualization technique, is applied 
responsive to a user input to enable user manipulation of the image, e.g. orientation 
and view angle at various resolutions. In alternate embodiments, processor 1 50 is 
adapted to enable interactive sessions with the image at higher resolutions. In 
alternative embodiments, other volume rendering techniques such as two- 
dimensional or three-dimensional texture mapping, maximum intensity value 
projection, minimum intensity value projection or composite ray casting are selected 
to generate a three-dimensional image of the breast using tomosynthesis data. In 
alternate embodiments, surface rendering techniques may be used alone or in 
combination with the various volume rendering techniques. It is to be appreciated that 
surface rendering techniques enables the ability to readily extract regular and 
irregular shaped volumes of interest, an ability which is desirable in reviewing 
tomosynthesis data. In other words, surface rendering will be used on some 
geometrical objects (e.g sphere, ellipse, tube, etc). The intersection of the 3D data 
with these geometrical objects can lead to the reconstruction of the volume of 
interests with the imaged 3D volume. 

[0050] 

In order to display and manipulate the three-dimensional rendered image for 
diagnosis purposes, two main parameters are desirably set for each voxel in the ray 
casting technique colors and opacity. Typically, there are two piecewise linear transfer 
functions that are used to set these parameters. One transfer function is used to set 
for colors (e.g. red, green and blue or RGB) and the other transfer function is used to 
set for opacity. Since, generally the rendered 3D image is shown in gray for most 
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radiologists, all of the red, green and blue values are typically the same. 

[0051] In. the field of visualization, it is typical to refer to color monitors with RGBA colors 
(Red, Green, Blue, and Alpha). These colors refer to the electronic guns in the 
monitors. If only the red gun is turned on then the pixels on the screen would appear 
red, if the red and the green guns are turned on then the pixels would appear yellow, 
and if all of the guns are turned on then the pixels would appear white. The strength 
of the intensity of the guns generates different levels of shading. When the intensities 
of all the electronic guns are changed by the same amount and thus the same value, 
the pixels would have different gray scale values. Typically, radiologists have been 
trained to look at films which have gray scale values, and they prefer to look at digital 
images also in gray scale values, but this could change if the radiologists were to get 
trained on color images. The alpha value (opacity) refers to blending two planes. One 
plane refers to the colors generated from the screen and the other is opacity plane or 
alpha plane. Therefore, each pixel has an alpha value associated with it. Generally, in a 
monotonically increasing transfer function a value of 1 means the pixel on the screen 
is very opaque and a value of 0 means the pixel is very transparent. 

[0052] Each transfer function maps the fully dynamic range of the original data into 

either 8 or more bits depending on the depth of the available display. Although the 
full dynamic range of the data is typically 1 5 bits, the necessary dynamic range to 
render a volume of interest (VOI) without a loss of depth of information requires 
generally a lesser number of bits. For instance, viewing only micro-calcification with 
full depth resolution requires a lesser number of bits than viewing both micro- 
calcifications and masses, cysts, or other lesions or soft tissue structures with full 
depth resolution. Thus, high resolution visualization of breast structures is possible 
utilizing embodiments of the present invention. 

[0053] 

Note that, micro-calcifications have a distribution of intensity values that are more 
separated than the soft tissue structure intensity value distribution. Therefore, to map 
or scale the 1 5 bits depth resolution (all of the intensity values including the 
distributions for both micro-calcifications and soft tissue structures) to 8 bit depth 
resolution, there would be a loss of depth information. However, one intensity value 
distribution (e.g soft tissue structures) covers fewer than 1 5 bits, and therefore 
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scaling one intensity value distribution to a 8 bits display leads to a lesser loss of 
depth information for that specific distribution. 

[0054] Figure 9 illustrates two piece linear transfer functions. One is used for mapping 
voxel values from a volume of interest in the breast with micro-calcifications and the 
other for mapping aVOI with spiculated lesions. Volume rendered images 
corresponding to the two transfer functions enable visualization of structures (micro- 
calcification or spiculated lesions). 

[0055] In an embodiment of the present invention, a method for generating a transfer 
function comprises obtaining a three-dimensional (3D) data set corresponding to an 
object volume, sampling the 3D data set, measuring the mean and standard deviation 
of the intensity values for the samples, and computing an upper limit and a lower limit 
of a linear ramp transfer function. 

[0056] In an exemplary embodiment, the three-dimensional data set is acquired by the 

methods described above relating to tomosynthesis and volume rendering. Thereafter, 
the 3D data set is randomly sampled with n number of samples, and then the mean 
and the standard deviation of the intensity values for those samples is measured. 
Afterwards, determine the lower limit and upper limit of a linear ramp transfer 
function based on the mean and standard deviation as shown the equation below: 

Lower Limit - LL » JJ, - N x G (1) 
Upper Limit - UL - (i + N x G 

Where JJ,, O, N are the mean, the standard deviation, and the number 

of standard deviations respectively. The corresponding opacity transfer function is as 
follows: 



{ 



A x<LL 
B ~ A x + c LL <x<UL 

x Z UL 



TF(x)= | UL-LL X + C ___ (2) 

B 



[0057] 



TF(x) is the transfer function, x is the voxel intensity value, A and B are the opacity 
values and they have values between 0 and 1 . C is the y-intercept with opacity y-axis. 
This linear transfer function can be increasingly or decreasingly monotonic depending 
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on the tissue intensity values. For instance, in 3DDM data, a value of one is assigned 
to the lower limit and a value of zero is assigned to the upper limit when a maximum 
intensity projection (MIP) is used for volume rendering. A less than one value (e.g. 0.5) 
is used if the other volume rendering technique is used (e.g. composite volume 
rendering). This is due to fact that denser tissues have lower intensity values than less 
dense tissue (e.g. micro-calcifications has low intensity values and are of great 
diagnostic importance for the radiologists). 

[0058] For MIP 3D visualization, the color transfer function may have the same shape as 
the opacity transfer function or may even have just a constant one value. For other 
volume rendering techniques (e.g. composite volume rendering), the color transfer 
function may have the same linear ramp characteristics, however, the lowest value 
should be zero and highest value should be 1 in order to leverage the maximum 
possible color range. 



[0059] Note that the higher the number of samples taken from the volume, the more 

ru 

reproducible the transfer functions are. However the price would be increasing 



processing time. Therefore, the tradeoff is reproducibility versus speed. 



m 

i. : 
& 

n [0060] In 3DDM data, the SNR is low. Therefore, it is desirable to use six standard 
2\ deviations in Equation 1 to provide an adequate estimate of the transfer functions. 

Q [0061 ] Processor 1 50 is typically a digital computer that is programmed to process 
imaging signals received from detector 1 20 during the x-ray procedure. In an 
embodiment of present invention, processor 1 50 is further adapted to generate 3D 
images based on tomosynthesis data, as described in greater detail above. As used 
herein, adapted to, configured and the like refer to operation capabilities of electrical 
elements such as analog or digital computers or application specific devices (such as 
an application specific integrated circuit (ASIC)) that are programmed to perform a 
sequel to provide an output in response to given input signals. An exemplary 
processor 1 50 may include a suitable computer (e.g., SPARC 20 workstation from Sun 
Microsystems PENTIUM based computer, etc.) having a hard, drive, input devices such 
as a keyboard, a mouse, magnetic storage media (e.g., tape cartridges or disks), 
optical storage media (e.g., CD-ROMs), and output devices such as a display and a 
printer. Suitable programming to perform the transformations* as explained in greater 
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detail above, is installed or embedded in processor 1 50. 

[0062] In a further embodiment, a system for generating three-dimensional images of an 
object volume is provided. The system comprises an imaging device and an image 
processing device. The imaging device, as described above, irradiates the volume with 
radiation at a plurality of radiating positions and further generates a plurality of 
spaced-apart planar images through the object volume derived by detecting radiation 
at the plurality of radiating positions. The image processing device, such as processor 
1 50 of FIG. 2, generates a three-dimensional image of the object volume based on the 
spaced-apart planar images. In another further embodiment of the image processing 
device, the image processing device is adapted to compute transfer functions as 
described above. Desirably, the image processing device is adapted to compute 
transfer functions based on obtained data without relying on user intervention such 
1% that optimal transfer functions are computed "on the fly". As used herein, an "on the 

[fj fly" computation is intended to refer to a substantially simultaneous event with the 

fU data acquisition. A system employing embodiments of the present invention thus 

; w; enables a radiologist or other user to visualize a rendered volume substantially 

c I : 

M without additional manipulation of the transfer function. 

rj [0063] The 3D image is available for display to a user of the system (a display device is 
FU not shown). In further embodiments, the image processing device is adapted to 

H respond interactively to inputs from a user of the system for a desired display format. 

^ For example, a user such as a radiologist may select a specific region or view angle of 

the rendered 3D volume or, alternatively, may want to review the 3D image based on 
parameters such as intensity. It is to be appreciated that with suitable programming 
processor 1 50 is adapted to respond to user input for a desired display of the 
rendered 3D image. In another further embodiment, processor 1 50 is adapted to 
provide an animated video display of the rendered 3D image. 

[0064] 

From the present description, it will be appreciated the apparatus may be 
configured to image a variety of objects, and is not limited to breast imaging. It will 
also be appreciated by those skilled in the art that the computation of transfer 
functions may also be applicable to any 3D application for which volume rendering is 
used and may also be applicable to any of the various medical imaging modalities 
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(e.g. ultrasound). 

[0065] While the preferred embodiments of the present invention have been shown and 
described herein, it will be obvious that such embodiments are provided by way of 
example only. Numerous variations, changes and substitutions will occur to those of 
skill in the art without departing from the invention herein. Accordingly, it is intended 
that the invention be limited only by the spirit and scope of the appended claims. 




L*. 
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